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A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 
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2a)D This action is FINAL. 2b)K This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 
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4) £3 Claim(s) 1-23 is/are pending in the application. 
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5) D Claim(s) 1 is/are allowed. 

6) ^ Claim(s) 1-23 is/are rejected. 
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DETAILED ACTION 



1. 



This action is responsive to the following communications: original application filed 



11/29/2001. 



2. 



Claims 1-23 are currently pending in this application. Claim 1 is independent claim. 



Priority 

3. Examiner acknowledges the claims for domestic priority under 35 U.S. C. 1 19 (e) to 
provisional application 60/253921, which was filed 1 1/29/2000. 



obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 102 of this title, if 
the differences between the subject matter sought to be patented and the prior art are such that the subject matter as a whole would 
have been obvious at the time the invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of the claims under 35 U.S.C. 103(a), the examiner 
presumes that the subject matter of the various claims was commonly owned at the time any inventions covered therein were made 
absent any evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1.56 to point out the inventor and invention 
dates of each claim that was not commonly owned at the time a later invention was made in order for the examiner to consider the 
applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (0 or (g) prior art under 35 U.S.C. 103(a). 



Claim Rejections - 35 USC § 103 



4. 



The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
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Claims 1-23 are rejected under 35 U.S.C. 103(a) as being unpatentable over Purnaveja 
et al. (U.S. 6,230,172 - filed 09/1999) in view of Nakayama et al. (U.S. 6,493,748 - 
filed 07/2000). 
As to independent claim 1 : 

a. Purnaveja teaches a computer-implemented method for integrating video data 

with a document object that includes document elements (e.g., a video and audio 
stream, together with annotations such as textual and graphical information in an 
integrated seamless package; col.2, lines 20-27 /Abstract), comprising the steps 
of: 

(i) synchronizing the video data with at least one of the document elements, 
so as to form at least one synchronization association, said 
synchronization association interrelating an activity of the video data with 
an activity of the document object (e.g., synchronizing the display of video 
streams with annotations ... displayable events, such textual/graphic data 
in the form of HTML pages; col.2, lines 37-42/ col. 5, lines 38-49/ col. 9, 
lines 46-54); 

(ii) generating a synchronization file that includes the synchronization 
association (e.g., the video/audio streams and annotation streams are 
stored in stream server(s); col.3, lines 7-10); and 

(iii) the activity involving the video data appears on a computer-human display 
as integrated with the document object through the use of the 
synchronization association (e.g., the client computer (s) is able to 
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synchronously display video frame and displayable event(s) in a video 
window and event window(s), respectively; col. 3, lines 9-12/col.5, lines 
39-49). 

b. Purnaveja does teach "synchronization file", but does not specifically teach 
"associating the synchronization file with the video data." 

c. Nakayama teaches associating the synchronization file with the video data 
(col. 13, lines 9-37). 

d. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Nakayama in the system of 
Purnaveja because it would have provided the capability for managing the 
synchronization file and the relevant URLs included in clips of the streaming 
content, whereby the correspondence between the reproduced content and its 
relevant information can be maintained. 

As to dependent claim 2: 

a. Purnaveja teaches the document object is a web page (e.g., HTML pages; 
Abstract), the activity involving the video data to appear on the computer-human 
display as integrated with the web page (col. 2, lines 20-27 /col. 5, lines 39-49), but 
does not specifically teach associating with the video clip. 

b. Note the discussion in the rejection of claim 1 above for associating with the 
video clip. 

As to dependent claim 3: 
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Purnaveja teaches the document object is a web page that contains a background, wherein 
the synchronization file associated with the video clip allows the activity involving the 
video data to appear on the computer-human display as integrated with the web page's 
background (col. 2, lines 20-27/col.5, lines 39-49). 
As to dependent claim 5: 

Purnaveja teaches the web page's background is a virtual web page background (col.2, 
lines 20-27/col.5, lines 39-49). 
As to dependent claim 6: 

Purnaveja teaches the document object is a web page (e.g., HTML pages; Abstract), 
wherein the video data is integrated into a web page in such a way that extraneous 
background of the web page is substantially hidden from view while the video data is 
played on the computer-human display (col. 6, line 6 J -col. 7, line 22). 
As to dependent claim 7: 

Purnaveja teaches the document object s a web page (e.g., HTML pages; Abstract), 
wherein the video data is integrated into a web page such a way that a media player 
running the video data is substantially hidden from view while the video data is played on 
the computer-human display (col.2, lines 20-26). 
As to dependent claim 8: 

Purnaveja teaches the document object is a web page (e.g., HTML pages; Abstract), 
wherein the video data is integrated into a web page in such a way that a media player 
running the video data is completely hidden from view while the video data is played on 
the computer-human display (col.2, lines 20-26). 
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As to dependent claim 9: 

Purnaveja teaches the document object is a web page (e.g., HTML pages; Abstract), 
wherein the synchronization association allows the activity involving the video to be 
activated based upon the activity associated with the document object (col. 3, lines 9- 
12/col.S, lines 39-49) 
As to dependent claim 10: 

Purnaveja teaches the activity associated with the web page is selection of a line of text 
appearing on the web page, wherein the synchronization association allows the activity 
involving the video to be activated based upon the selection of the line of text (col. 2, lines 
20-42 / col. 5, lines 39-49 / col. 7, lines 35-39). 
As to dependent claim 11: 

Purnaveja teaches the document object is a web page (e.g., HTML pages; Abstract), 
wherein the synchronization association allows the activity involving the web page to be 
activated based upon the activity associated with the video data (col. 3, lines 9-12/col.5, 
lines 39-49). 

As to dependent claim 12: 

Purnaveja teaches the activity associated with the video data is the video data reaching a 
preselected time during playing of the video data (col. 7, lines 35-39 and Fig. 7), wherein 
the synchronization association allows the activity involving the web page to be activated 
based upon the activity associated with the video data (col.3, lines 9-12/col.5, lines 39- 
49). 

As to dependent claim 13: 
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Pumaveja teaches the activity involving the web page is a display of at least one line of 
text (col. 2, lines 20-42 / col. 5, lines 39-49 /col.7, lines 35-39). 
As to dependent claim 14: 

Purnaveja teaches synchronizing the video data with a second web page element so as to 
form a second synchronization association, said second synchronization association 
interrelating a second activity of the video data with a second activity of the web page 
(col. 2, lines 37-42/ col. 5, lines 38-49), wherein the synchronization file includes the 
second synchronization association,/ col. 3, lines 9-12/col.5, lines 39-49), wherein the 
second association activity associated with the video data is the video data reaching a 
second preselected time during playing of the video data, wherein the second 
synchronization association allows the second activity involving the web page to be 
activated based upon the second activity associated with the video data (col. 9, lines 46- 
54). 

As to dependent claim 15: 

Purnaveja teaches the second activity involving the web page is a display of a second line 
of text (col. 2, lines 20-42 / col. 5, lines 39-49 / col. 7, lines 35-39). 
As to dependent claim 16: 

a. Purnaveja does not specifically teach "preprocessing the video data before the 
video is synchronized at said step (a)." 

b. Nakayama teaches the preprocessing of the video data before the video is 
synchronized (col.4, lines 11-18/ col.6, lines 31-34/col.l2, lines 2-6). 
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c. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Nakayama in the system of 
Purnaveja because it would have provided the capability for reproduces clips of 
the streaming content when a start time specified in the synchronization file has 
come. 

As to dependent claim 17: 

a. Purnaveja does not specifically teach "the preprocessing of the video data 
includes preprocessing the video data through a chromakey process to remove a 
colored screen background and replace it with the web page's background." 

b. Nakayama teaches the preprocessing of the video data (col. 4, lines 11-18/ col.6, 
lines 31-34/col.l2, lines 2-6) includes preprocessing the video data through a 
chromakey process to remove a colored screen background and replace it with the 
web page's background. 

c. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Nakayama in the system of 
Purnaveja because it would have provided the capability for reproduces clips of 
the streaming content when a start time specified in the synchronization file has 
come. 

As to dependent claim 18: 

a. Purnaveja does not specifically teach "the preprocessing of the video data 
includes the video data being cropped and resized." 
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b. Nakayama teaches the preprocessing of the video data includes the video data 
being cropped and resized (col.4, lines 11-18/ col.6, lines 31-34/col.l2, lines 2-6). 

c. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Nakayama in the system of 
Purnaveja because it would have provided the capability for creating compressed 
data by diving the streaming content from the synchronization file. 

As to dependent claim 19: 

Purnaveja teaches the preprocessing of the video data includes compressing the video 
data, and using the compressed video data in the synchronizing of the video data with a 
document element during said step (a) (e.g., compressed video stream ...for 
synchronizing the display of video streams; Abstract /col. 2, lines 29-58 and FigAA). 
As to dependent claim 20: 

Purnaveja teaches the preprocessing of the video data includes using the video data in an 
uncompressed format so that quality adjustments to the video data may be performed 
(e.g., uncompressed video data; col.6, lines 1-7). 

Conclusion 

5. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

Hidary et al. U.S Patent No. 5,774,664 issued: Jun. 30, 1998 

Veghte et al. U.S Patent No. 5,897,640 issued: Apr. 27, 1999 

Balch U.S Patent No. 6,141,001 issued: Oct. 31,2000 
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Chaddha et al. 



U.S Patent No. 6,173,317 



issued: Jan. 9, 2001 



Limaye 



U.S Patent No. 6,642,966 



issued: Nov. 4, 2003 



Chang et al. 



U.S Patent No. 6,715,126 



issued: Mar. 30, 2004 



Paul et al., "Real-time for Synchronized Presentation of Multimedia Information in 
Distributed Multimedia Systems", IEEE, pp. 177-184, 1997. 

Patel et al., "Synchronized Continuous Media Playback Through the World Wilde Web", 
ACM Multimedia 96, pp.435-436. 

Matoba et al., "WebSync: A System for Synchronization of Analog Sequential Media and 
WWW", IEEE, pp.132-141, 1997. 

Chen et al., "A Synchronized and Retrievable Video/HMTL Lecture System for Industry 
Employee Tranining", IEEE, pp.750-755, 1999. 
6. Any inquiry concerning this communication or earlier communications from the 

examiner should be directed to Maikhanh Nguyen whose telephone number is (571) 272- 
4093. The examiner can normally be reached on Monday - Friday from 9:00am - 5:30 
pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Joseph H Feild can be reached on (571) 272-4090. 
The fax phone number for the organization where this application or proceeding is 
assigned is 703-872-9306. 
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information for unpublished applications is available through Private PAIR only. For 
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Center (EBC) at 866-217-9197 (toll-free). ^ 
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